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ABSTRACT 

> 

The scalar sector of the Randall-Sundrum model is discussed. The effective poten- 
tial for the Standard Model Higgs-boson (h) interacting with Kaluza-Klein excita- 



\Q \ tions of the graviton (h^ n ) and the radion (</>) has been derived and it has been 

shown that only the Standard Model vacuum solution of dV/ dh = is allowed. The 
O ' theoretical and experimental consequences of the curvature-scalar mixing £ R H^H 

, introduced on the visible brane are considered and simple sum rules that relate the 

Ph! couplings of the mass eigenstates h and to pairs of vector bosons and fermions 

o 1 are derived. The sum rule for the ZZh and ZZcf) couplings in combination with 

LEP/LEP2 data implies that not both the h and <fi can be light. We present ex- 
plicit results for the still allowed region in the (m^m^) plane that remains after 
imposing the LEP upper limits for non-standard scalar couplings to a ZZ pair. 
^ ■ The phenomenological consequences of the mixing are investigated and, in particu- 

lar, it is shown that the Higgs-boson decay h — > (fxp would provide an experimental 
signature for non-zero £ and can have a very substantial impact on the Higgs-boson 
searches, having BR(h — > <fr<j)) as large as 30 -7- 40 %. 
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1 Introduction 

Although the Standard Model (SM) of electroweak interactions describes success- 
fully almost all existing experimental data the model suffers from many theoretical 
drawbacks. One of these is the hierarchy problem: namely, the SM can not con- 
sistently accommodate the weak energy scale 0(1 TeV) and a much higher scale 
such as the Planck mass scale O(10 19 GeV). Therefore, it is commonly believed 
that the SM is only an effective theory emerging as the low-energy limit of some 
more fundamental high-scale theory that presumably could contain gravitational 
interactions. In the last few years there have been many models proposed that 
involve extra dimensions. These models have received tremendous attention since 
they could provide a solution to the hierarchy problem. One of the most attractive 
attempts has been formulated by Randall and Sundrum pQ, who postulated a 5D 
universe with two 4D surfaces ( "3-branes" ) . All the SM particles and forces with 
the exception of gravity are assumed to be confined to one of those 3-branes called 
the visible brane. Gravity lives on the visible brane, on the second brane (the 
"hidden brane" ) and in the bulk. All mass scales in the 5D theory are of the order 
of the Planck mass. By placing the SM fields on the visible brane, all the mass 
terms (of the order of the Planck mass) are rescaled by an exponential suppression 
factor (the "warp factor") f2o = e -m ° b °/ 2 , which reduces them down to the weak 
scale 0(1 TeV) on the visible brane without any severe fine tuning. To achieve 
the necessary suppression, one needs rriobo/2 ~ 35. This is a great improvement 
compared to the original problem of accommodating both the weak and the Planck 
scale within a single theory. 

In order to obtain a consistent solution to the Einstein equations corresponding 
to a low-energy effective theory that is flat, the branes must have equal but opposite 
cosmological constants and these must be precisely related to the bulk cosmological 
constant. 

The model is defined by the 5D action: 



S 




(1) 



2 



where g^ u (fi,V = 0,1,2,3,4) is the bulk metric and g^ d (x) = g^ u (x,y = 0) 
and g^i S {x) = g^ u {x,y = 1/2) (fi, v = 0,1,2,3) are the induced metrics on the 
branes. One finds that if the bulk and brane cosmological constants are related by 
A/m = — Vhid = V vis = —6m /k 2 and if periodic boundary conditions identifying 
(x, y) with (x, —y) are imposed, then the 5D Einstein equations lead to the following 
metric: 

ds 2 = e- 2aiy) r }lxv dx fi dx u - b 2 dy 2 , (2) 

where a{y) = m b [y(29(y) — 1) — 2(y — l/2)9(y — 1/2)]; fe is a constant parame- 
ter that is not determined by the action, Eq. (J2J). Gravitational fluctuations around 
the above background metric will be defined through the replacement: 

Vtiv -> Vtw + eh^x, V) b ^b Q + b(x) . (3) 

Below we will be expanding in powers of eh^ = \[2kh liv and b(x)/bo. 

The paper is organized as follows. First, in Sec. El we derive the effective po- 
tential for the SM Higgs-boson sector interacting with Kaluza-Klein excitations of 
the graviton {h u ^ n ) and the radion (0). In Sec. 01 we introduce the curvature-scalar 
mixing ^RH^H and discuss its consequences for couplings and interactions. In 
Sec. HI we discuss some phenomenological aspects of the scalar sector, focusing on 
the particularly important possibility of h — > <f)<j) decays. We summarize our results 
in Sec. El 

Our work extends in several ways the already extensive literature 013111 13 EE El 
0| on the phenomenology of the Randall-Sundrum model. We focus in particular 
on the case where the radion is substantially lighter than the Higgs boson and the 
important impacts of Higgs-radion mixing in this case. 

2 The effective potential 



The canonically normalized massless radion field <f>o(x) is defined by: 



/ fi \ X /2 / R X 1/2 

o (x) = (^) n b (x) = (^) e - m ^' 2 . (4) 

Keeping in mind that h liV {x,y) depends both on x and y, we use the KK 
expansion in the extra dimension 

h, u (x,y)=Y,KM^- ( 5 ) 

- 3 - 



The total 4D effective potential (up to the terms of the order of 0[(eh nu ) 3 }) has 
been determined in Ref. [10] . Restricting ourselves to the trace part of /i" ~ ^rj^Ji 1 
the result is the following: 

yT /brane , t tKK 
*ff = V eff + V eff = 



1 



Aw n 4A VK n m J \ Ly 4> ) 



-T^™l(h n ) 2 + ---i (6) 

where m n is the KK-graviton mass, Aw = 2\/&o/ [ex n ( 1/2)] — v^2^p;^o an d 
we have expanded around the vacuum expectation values for the radion, O ~~ > 
(0o } + 0o = A </> + 0o- 111 order to stabilize the size of the extra dimension we have 
introduced the radion mass m^ without specifying its origin. Restricting ourself 
to the perturbative regime we will look for the minimum of V e ff that satisfies 
J2nh" '/Aw *C 1 and b(x)/bo <C 1, the latter being equivalent to (f> (x)/A ( f ) <C 1: 



Aw 2A? 



E^ 1 



— V + -m 



A,J 2 



3 



— —mih" = 



(7) 



AwY 4A 2 w Vtr A A J 



(9) 



There is only one solution of Eq. (jOJ consistent with 4>o/ A^ <C 1 and IT /Aw ^ 1: 
namely, 9V d ^ = 0. For consistency of the RS model we must also require that 
V((ho)) = 0. If V((ho)) 7^ 0, then the visible brane tension would be shifted away 
from the very finely tuned RS solution to the Einstein equations. With these two 
ingredients, Eq. (jHJ) implies that (0o) = at the minimum, implying that we have 
chosen the correct expansion point for O ; an d Eq. J7J) then implies that (h } = 0, 
i.e. we have expanded about the correct point in the IT" fields. However, it is only 
if m| o > that (4>q) = is required by the minimization conditions. If = 0, 
then Eq. (|ZJ) still requires (K 1 ) = but all equations are satisfied for any (<f>o). 
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Finally, we note that since dV/dh = at the minimum (even after including 
interactions with the radion and KK gravitons) there are no terms in the potential 
that are linear in the Higgs field ho (so in particular no ho—<po mass mixing emerge). 
We will return to this observation in the next section of the paper. 

3 The curvature- scalar mixing 

Having determined the vacuum structure of the model, we are in a position to 
discuss the possibility of mixing between gravity and the electroweak sector. The 
simplest example of the mixing is described by the following action 

Si = ij d 4 x^-R(g vis )WH , (10) 



where R(g v i S ) is the Ricci scalar for the metric induced on the visible brane g 
tt 2 b (x)(ri^ + ehT). Using H = tt H one obtains [12] 



fiV 

vis 



^^/g—R(g vis )WH = 6&(x) (-DQ(x) + eh^d^Q + ■ • •) H^Ho . (11) 

To isolate the kinetic energy terms we use the expansion 

Ho=4=(vo + h ), Q(x) = l + ^. (12) 

The hpv term of Eq. (|11|) does not contribute to the kinetic energy since a partial 
integration would lead to h^d^d^Q = —d^h^dTl = by virtue of the gauge 
choice, d^h^ v = 0. We thus find the following kinetic energy terms: 

£ = -\ {l + 6 7 2 £} 00^00 - |0o"40o - \ho{U + m 2 hQ )ho - G^o^ho , (13) 

where 7 = v /A^ and m\ o = 2Xv 2 and m? are the Higgs and radion masses before 
the mixing. The above differs from Ref. ^3] by the extra 00^00 piece proportional 
to £. 

We define the mixing angle 9 by 

2 

tan 26 = Uj^Z— 2 —~ 2 2 . , (14) 

m i - m h ( z2 - 36^ 2 7 2 ) 

where 

Z 2 = 1 + 6£ 7 2 (1 - 60 • (15) 
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In terms of these quantities, the states that diagonalize the kinetic energy and have 

canonical normalization are h and with: 

( 6^7 \ / 6^7 \ 

ho = lcos# — sin 9 I h + I sin 9 H — — cos 9 I = dh + c0 (16) 

0o = — cos 9^- + sin 9— = a<p + bh . (17) 

Zj Z 

(Our sign convention for O is opposite to that chosen for r in Ref. J2]-) To 
maintain positive definite kinetic energy terms for the h and 0, we must have 
Z 2 > 0. (Note that this implies that (3 = 1 + 6^7 2 > is implicitly required.) The 
corresponding mass-squared eigenvalues are 

m l = ^Z~2 (< + /Ko ± {Ko + ^ol 2 - 4 ^ 2 «} 1/2 ) • (18) 

It follows from the above formula that m± cannot be too close to being degenerate 
in mass, depending on the precise values of £ and 7, see Ref.|l()j. 

We now turn to the important interactions of the h, and /1™ . We begin 
with the ZZ couplings of the h and 0. The ho has standard ZZ coupling while 
the 0o has ZZ coupling deriving from the interaction using the covariant 

derivative portions of THho). The result for the 77^ portion of the ZZ couplings 
is: 

9 m z /j . n gm z 
gzzh= (d + 76), gzzcf, = (0 + 70) , (19) 

Cw Cw 

where a, b, c and d are defined through Eqs. (|lfiJ17|) and g, cw denote the 577(2) 

gauge coupling and cosine of the Weinberg angle, respectively . The WW couplings 

are obtained by replacing gmz/cw by gmw Notice also an absence of Zh<p tree 

level couplings. Next, we consider the fermionic couplings of the h and 0. The h 

has standard fermionic couplings and the fermionic couplings of the 0o derive from 

_ss.rpjj, us i n rr the Yukawa interaction contributions to Tff. One obtains results in 

a.0 ° Al- 

dose analogy to the VV couplings just considered: 

9ffh = -f^ L (d + lb) gff =-i^L{ c + ia ) (20) 
2mw 2 raw 

For small values of 7, the gzzh and <7zz</> have the expansions: 



gzzh 
gzz<j> 



gmz 
cw 

gm z 

c w 



1 + 0(7% (21) 
-7(l + ^W 
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Entirely analogous results apply for the fermionic couplings. 

The following simple and exact sum rules (independently noted in jB]) follow 
from the definitions of a, b, c, d: 

9zzh + 9zz4> _ 9 ffh _ y ff<j> 

(am z \ 2 ( gm.j \ 2 

\ c w ) \2m w ) 

Note that R 2 > 1 is a result of the non-orthogonality of the relations Eq. (|T6j) and 
Eq. (|17|) . Of course, R 2 = 1 in the conformal limit, £ = 1/6. It is important to 
note that Z — > would lead to divergent ZZ and // couplings for the 0. As noted 
earlier, this was to be anticipated since Z — > corresponds to vanishing of the 
radion kinetic term before going to canonical normalization. After the rescaling 
that guarantees the canonical normalization, if Z — > the radion coupling constants 
blow up: gzz4> oc (c + 7a) ~ l/(6£yZ) + OiZ). To have Z 2 > 0, £ must lie in the 
region: 

kk-f^^kk+f*?)- (23) 

As an example, for A^, = 5 TeV, Z 2 > corresponds to the range —3.31 < £ < 3.47. 
Of course, if we choose £ sufficiently close to the limits, Z 2 — > implies that the 
couplings, as characterized by -R 2 will become very large. Thus, we should impose 
bounds on £ that keep R 2 moderate in size. For example, for A^ = 5 TeV, R 2 
in Eq. ()22jl takes the values 2.48 and 1.96 at £ = —2.5 and £ = 2.5, respectively. 
Therefore we will impose an overall restriction of R < 5. In practice, this bound 
seldom plays a role, being almost always superseded by the constraint limiting £ 
according to the degree of nih — degeneracy. 

The final crucial ingredient for the phenomenology that we shall consider is the 
tri-linear interactions among the h and <fi and h™ u fields. In particular, these are 
crucial for the decays of these three types of particles. The tri-linear interactions 
derive from four basic sources. 

1. First, we have the cubic interactions coming from 

C 3 -V(H ) = -X(HlH - l -vl) 2 = -X(v 2 h 2 + v hl + \K) , (24) 

after substituting H = ^(^o + ho). Since A is related to the bare Higgs- 
boson mass in a usual way: m 2 o = 2Xvq the interaction can be expressed 

-7- 



1 + 



Z 2 



R 2 



(22) 



as 

,2 



C 3 (25) 

2. Second, there is the interaction of the radion <po with the stress-energy mo- 
mentum tensor trace: 

C 3 -^T£{ho) = -p- (-d p h d p h + 4\v 2 hl) ■ (26) 

3. Thirdly, we have the interaction of the KK-gravitons with the contribution 
to the stress-energy momentum tensor coming from the ho field: 



C 3 -~K„T^ 3 - J- J2 h; u d»h d»h , (27) 

^ A-W n 



where we have kept only the derivative contributions and we have dropped 
(using the gauge h pn = 0) the rf" parts of T^ v . 

4. Finally, we have the ^-dependent tri-linear components of Eq. (fTTj) : 



Q^n(x) (-Dfi(x) + eh liV d' J -d v n{x)) W H 3 -3-^D0 o 



A, 



A A^/A^, n 



% 2 



-ee^-^E^^^o (28) 

where we have employed d^h^ = 0, used the traceless gauge condition h^ n = 
0, and also used the symmetry of h pu . 

As seen from the above list, without the curvature- Higgs mixing the lagrangian 
does not contain any interactions linear in the Higgs field, therefore vertices like 
4> 2 h and h n (ph (that follows from Eq. (|28jl ) are a clear indication for the curvature- 
Higgs mixing. As we shall see, the <p 2 h coupling could also be of considerable 
phenomenological importance leading to h — > <fxj) decays. The h n (f>h coupling would 
be relevant for h — » <ph n , however for the parameters range considered here that 
decay would be relatively rare. 
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4 Phenomenology 



We begin by discussing the restrictions on the h, sector imposed by LEP Higgs- 
boson searches. Since no scalar boson (s) was observed in the process e + e~ — > Zs, 
LEP/LEP2 provides an upper limit for the coupling of a ZZ pair to the scalar as 
a function of the scalar mass. Here we will employ the limits from O ITSI I16j . 

The first question that arises is whether both the and the h could be light 
without either having been detected at LEP and LEP2. The sum rule of Eq. (}2*2*j) 
implies that this is impossible since the couplings of the h and to ZZ cannot 
both be suppressed. For any given value of rrih and m^, the range of £ is limited 
by: (a) the constraint limiting £ according to the degree of rrih — degeneracy; 
(b) the constraint that Z 2 > 0, Eq. (|15|): and (c) the requirements that g 2 ZZh and 
9zz<t> both lie below any relevant LEP/LEP2 limit. The regions in the (£,m^) 
plane consistent with the first two constraints as well as with R < 5 are shown 
in Figs. ^ and 121 for rrih — H2 GeV and rrih = 120 GeV, respectively, assuming 
a value of = 5 TeV. For the most part, it is the degeneracy constraint (a) 
that defines the theoretically acceptable regions shown. The regions within the 
theoretically acceptable regions that are excluded by the LEP/LEP2 limits are 
shown by the yellow shaded regions, while the allowed regions are in blue. For 
rrih = 112 GeV, the LEP/LEP2 limits exclude a large portion of the theoretically 
consistent parameter space. For m h = 110 GeV (not plotted), the sum rule of 
Eq. (j22J) results in all of the theoretically allowed parameter space being excluded 
by LEP/LEP2 constraints. For m h = 120 GeV, the LEP/LEP2 limits do not apply 
to the h and it is only for < 115 GeV and significant g ZZf p (requiring large |£|) 
that some points are ruled out by the LEP/LEP2 constraints. As a result, the 
allowed region is dramatically larger than for rrih = 112 GeV. The precise regions 
shown are somewhat sensitive to the choice, but the overall picture is always 
similar to that presented here for A^ = 5 TeV. 

In order to illustrate LHC Higgs-boson discovery potential in the presence of 
the curvature-mixing we plot in Fig. El the ratio of the rates for gg — > h — > 77, 
WW — > h — > t + t~ and gg — > tih — > ttbb (the latter two ratios being equal) to 
the corresponding rates for the SM Higgs boson. All the curves are plotted for the 
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Allowed! Regions; and LEP/LEP2 Constraints 




i 

Figure 1: Allowed regions (see text) in m^,) parameter space for A^, = 5 TeV 
and rrih = 112 GeV. The dark red portion of parameter space is theoretically 
disallowed. The light yellow portion is eliminated by LEP/LEP2 constraints on 
the ZZs coupling-squared Qzzs or 011 9zzs-BR(s - ► bb), with s = h or s = <fi. 



Allowed! Regions and LEP/LEP2 Constraints 




Figure 2: As in Fig. [T]but for m h = 120 GeV. 

parameter range that is consistent with the theoretical and experimental constraints 
mentioned above. For this figure, we take = 120 GeV and A^ = 5 TeV and 
show results for = 20, 55 and 200 GeV. As will be discussed later, in the case 
of = 55 GeV, the h — > (fxfi decay is substantial for large |£|. The resulting 
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suppression of the standard LHC modes at the largest allowed |£| values is most 
evident in the W + W~ — > h — > t + t~ curves. Another important impact of mixing 
is through communication of the anomalous gg coupling of the 0o to the h mass 
eigenstate. The result is that prospects for h discovery in the gg — > h — > 77 mode 
could be either substantially poorer or substantially better than for a SM Higgs 
boson of the same mass, depending on £ and m^. 
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Figure 3: The ratio of the rates for gg — > h — > 77 and WW — > h — > t + t~ (the 
latter is the same as that for gg — > tih — > ttbb) to the corresponding rates for 
the SM Higgs boson. Results are shown for = 120 GeV and = 5 TeV as 
functions of £ for = 20, 55 and 200 GeV. 

At the LC, the potential for h discovery is primarily determined by g ZZh - As we 
have shown in Ref. ^0], this coupling-squared (relative to the SM value) is often 
> 1 (and can be as large as ~ 5), but can also fall to values as low as ~ 0.4, 
implying significant suppression relative to SM expectations. However the latter 
suppression is still well within the reach of the e + e~ — > Zh recoil mass discovery 
technique at a LC with = 500 GeV and L = 500 fb" 1 . 

A particularly important feature of Figs.^and|2]is that once is large enough 
(typically rrih > 115 GeV is sufficient) it will generally be possible to find £ values 
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for which a range of moderately small, and possibly even very small, values 
cannot be excluded by LEP/LEP2 constraints. In particular, < (so that 

h — > (jxj) decays are possible) is typically not excluded for a substantial range of £. 
(The reverse is also true; allowed parameter regions exist for which — ^ hh decays 
are possible once > 100 GeV. However, for this paper we have chosen to focus 
on cases in which the is not very heavy.) With this in mind, we now turn to a 
discussion of branching ratios, focusing on the h — > (j)(f) final mode: 

^-^^^a!* 1 - 4 ^ 1 ' 2 - < 29 > 



where A(l, r%, T2) = 1 +rf + r\ — 2r\ — 2r2 — 2rir2, = m 2 ,jm 2 hl r n = m 2 n jm\ an 



= 2ml 



6a£(~/(ad + be) + cd) + be 2 (30) 



+m 2 h c [12a&7£ + 2ad + bc(Q£ - 1)] - Ac(2ad + bc)m 2 ho - c 2 dm 2 ho . 

The branching ratios for h — > 00 in the case of rrih = 120 GeV and = 5 TeV 
are shown in Fig. 0] for various £ choices within the allowed region. The plots show 
that h — > <p(j) decays can be quite important at the largest |£| values when is 
close to mf L /2. Detection of the h — > (jxj) decay mode could easily provide the most 
striking evidence for the presence of £ 7^ mixing. In order to understand how 
to search for the h — > 00 decay mode, it is useful to know how the decays. In 
Fig. |4] we give detailed results for BR(cf) — > gg) and BR((p — > bb) for the same 
m^ and £ values for which BR(h — > 00) is plotted. (The cc and r + r~ channels 
supply the remainder.) For £ > 0, BR(<j) — > bb) is always substantial and might 
make detection of the h — > 00 — > 4b and h — > 00 — > 2g2b final states possible. 
The — > 77 decay mode always has a very tiny branching ratio and the related 
detection channels would not be useful. 

One will probably first search for the h in the modes that have been shown to 
be viable for the SM Higgs boson. We have given in Fig. El the rates for important 
LHC discovery modes relative to the corresponding SM values in the case of m^ = 
55 GeV. Results for other m^ < m^/2 values are similar in nature. We observe 
that the WW — > h — > t + t~ and gg — > tth — > tibb detection modes are generally 



^ote that both diagonal physical masses and the bare Higgs-mass parameter m/j appear 
below. 
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hand graphs) and for £ = 0.66, 1.16, 1.66, and 2.16 (right-hand graphs). 



sufficiently mildly suppressed that detection of the h in these modes should be 
possible (assuming full L = 300 fb~ x luminosity per detector). The gg — » h — > 77 
detection mode could either be enhanced or significantly suppressed relative to 
the SM expectation. Once the h has been detected in one of the SM modes, a 
dedicated search for the h — » 00 — > bbbb and h — > 00 — * decay modes will 
be important. At the LHC, backgrounds for these modes will be substantial and a 
thorough Monte Carlo assessment will be needed. 
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5 Summary and Conclusions 



We have discussed the scalar sector of the Randall- Sundrum model. The effective 
potential (defined as a set of interaction terms that contain no derivatives) for 
the Standard Model Higgs-boson sector interacting with Kaluza-Klein excitations 
of the graviton (h^ n ) field and the radion (</>) field has been derived. Without 
specifying its origin, a stabilizing mass-term for the radion has been introduced. 
After including this term, we have shown that only the Standard Model vacuum 
determined by dV/dh = is allowed. An important requisite property for the 
correct vacuum solution is that the effective potential does not contain any terms 
linear in the Higgs field. 

Having confirmed that the usually assumed vacuum properties are correct, we 
pursue in more detail the phenomenology of the RS scalar sector, focusing in par- 
ticular on results found in the presence of a curvature-scalar mixing £ RH^H con- 
tribution to the Lagrangian. Simple sum rules that relate Higgs-boson and radion 
couplings to pairs of vector bosons and fermions have been derived. Of particular 
interest is the fact that non-zero £ induces interactions linear in the Higgs field: 
4> 2 h and h n h(p. 

We derive the regions of parameter space that are excluded by direct LEP/LEP2 
limits on scalar particles with ZZ coupling as function of scalar mass. Of particular 
note is the fact that the sum rule for ZZh and ZZ<fi squared-couplings noted above 
implies that it is impossible for both the h and <fi to be light. However, even very 
light cf) (m^ < 10 GeV) remains a possibility if > 115 GeV and the (dominant) 
(p — > gg decays result in final states to which existing searches for on-shell Z — > Z*<p 
decays would not have been very sensitive. 

One particularly interesting complication for £ ^ is the presence of the non- 
standard decay channels, h — > <jxj) and h — > h n cf). These could easily be present 
since in the context of the RS model there is a possibility (perhaps even a slight 
preference) for the to be substantially lighter than the h. In particular, < 
rrih/Z is a distinct possibility. We study in detail the phenomenology when < 
60 GeV for m/, = 120 GeV, so that the h — > (jxj) mode is present. Even for a 
relatively conservative choice of the new-physics scale, = 5 TeV, this mode 
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will be present at an observable level, and, at the largest |£| values and for 
not far below can even substantially dilute the rates for the usual h search 

channels. In any case, detection of h — > 00 is very important as it would provide 
a crucial experimental signature for non-zero £. For the less conservative choice 
of = 1 TeV and for a light h, e.g. m h = 120 GeV, BR{h — > 00) could easily 
be as large as 50 % for most of the theoretically allowed values of (which are 
near when |£| is near the largest value allowed by theoretical and existing 

experimental constraints. 
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